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Abstract 

Objective To investigate whether published results of industry funded 
trials of recombinant human bone morphogenetic protein 2 (rhBMP-2) 
in spinal fusion match underlying trial data by comparing three different 
data sources: individual participant data, internal industry reports, and 
publicly available journal publications and conference abstracts. 

Data collection and synthesis The manufacturer of rhBMP-2 products 
(Medtronic; Minneapolis, MN) provided complete individual participant 
data and internal reports for all its studies of rhMBP-2 in spinal fusion. 
We identified publications and conference abstracts through 
comprehensive literature searches. We compared outcomes provided 
in the individual participant data against outcomes reported in 
publications. For effectiveness outcomes, we compared meta-analyses 
of randomised controlled trials based on each of the three data sources. 
For adverse events, meta-analysis of the published aggregate data was 
not possible and we compared the number and type of adverse events 
reported between data sources. 

Results 32 publications reported outcomes from 11 of the 17 existing 
manufacturer sponsored studies. For individual randomised controlled 
trials, 56% (9/16) to 88% (15/17) of effectiveness outcomes known to 
have been collected were reported in the published literature. 
Meta-analyses of effectiveness data were almost identical for pain 
outcomes and similar for fusion across the three data sources. A minority 
of adverse event data known to have been collected were reported in 
the published literature. Several journal articles reported only "serious," 
"related," or "unanticipated" adverse events, without defining these terms. 
Others reported a small proportion of the collected adverse event 



categories. Around 23% (533/2302) of the total adverse events collected 
in published randomised controlled trials have been reported in the 
literature, with randomised controlled trials evaluating the licensed 
preparation (Infuse) reporting around 11% (122/1108) of collected 
adverse events. 

Conclusions The published literature only partially represents the total 
data known to have been collected on the effects of rhBMP-2. This did 
not lead to substantially different results for meta-analysis of effectiveness 
outcomes. In contrast, reporting of adverse event data in trial publications 
was inadequate and inconsistent to the extent that any systematic review 
based solely on the publicly available data would not be able to properly 
evaluate the safety of rhBMP-2. Analysis of individual participant data 
enabled the most complete, detailed, and in-depth analysis and was not 
more resource intensive than extracting, collating, and analysing 
aggregate data from multiple trial publications and conference abstracts. 
Confidential internal reports presented considerably more adverse event 
data than publications, and in the absence of individual participant data 
access to these reports would support more accurate and reliable 
investigation, with less time and effort than relying on incomplete 
published data. 

Introduction 

In 2002, the US Food and Drug Administration approved the 
use of recombinant human bone morphogenetic protein 2 
(rhBMP-2, Infuse; Medtronic) in anterior lumbar interbody 
fusion as an alternative to traditional iliac crest bone graft 
techniques for spinal fusion surgery. Since then, use of this 
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product in spinal surgery — including in "off label" 
procedures — has increased rapidly. 

Published industry sponsored trials of rhBMP-2 reported clinical 
benefits and stated that there were no (or no unanticipated) 
adverse events relating to rhBMP-2 treatment. 1-12 However, from 
2006, several non-industry published studies reported potential 
adverse events associated with the use of rhBMP-2. In 2008, 
the FDA issued a public health notification of potentially life 
threatening complications associated with swelling of neck and 
throat tissue after rhBMP-2 use in the cervical spine. 13 A 
subsequent review of publicly available data suggested an 
increased risk of complications and adverse events for patients 
receiving rhBMP-2 that was 10 to 50 times higher than the 
original estimates. 14 However, the authors of that review did not 
have access to either the original study data or the confidential 
internal reports for these industry funded studies. 

In June 201 1, a US Senate Finance Committee investigation of 
publishing practices was initiated, focusing on the relationships 
between the sponsor (Medtronic) and clinical authors of 
published articles. Amid this controversy, the Yale University 
Open Data Access (YODA) project 15 reached a landmark 
agreement with Medtronic for the manufacturer to provide full 
individual participant data and internal reports from all their 
studies of rhBMP-2 in spinal fusion surgery, and importantly 
to allow unrestricted independent reanalysis of these data. 

We conducted one of the two unrestricted reanalyses 
commissioned by and funded through Yale, details of which 
are reported elsewhere. 15 16 YODA acted as an intermediary, 
ensuring there was no direct contact between Medtronic and 
the analysis teams, thereby assuring independence. Our 
systematic review of the Medtronic individual participant data 
and one additional randomised controlled trial showed that, 
compared with iliac crest bone graft, rhBMP-2 resulted in a 
small statistically significant increase in fusion rate and a modest 
reduction in pain at two years that fell below clinically important 
thresholds. Although there were signals of other potential harms 
including sterility (retrograde ejaculation), numbers of events 
were small giving rise to considerable uncertainty and 
inconclusive findings. The systematic review also found 
evidence that rhBMP-2 increases early post-surgical pain. 
Evidence of an increased incidence of cancer was 
inconclusive. 15 16 

An integral part of our research proposal was to additionally 
investigate whether published results of the rhBMP-2 trials 
matched the provided individual participant data and to consider 
if and how this might impact on a standard systematic review. 
We therefore compared the results of our individual participant 
data meta-analysis of the data provided by Medtronic with 
meta-analyses of summary data extracted from the published 
literature and from the internal reports provided by the 
manufacturer. 

"Individual participant data" refers to the raw data files (supplied 
as SAS files in this case) and "internal reports" refers to the 
written internal Medtronic reports of the trial, containing 
detailed, tabulated data (but not full case histories) for outcomes 
and adverse event report forms for each patient. 

Methods 

We compared three different sources of study data: individual 
participant data provided by the manufacturer, confidential 
internal reports, and publicly available journal publications and 
conference abstracts. 



Identifying the evidence 

As part of the YODA agreement, Medtronic provided complete 
individual participant data for all their clinical studies of 
rhMBP-2 in patients undergoing spinal fusion surgery for 
treatment of degenerative disc disease, spondylolisthesis, or 
other relevant spinal conditions. They also provided internal 
reports, protocols, and citation details for these studies. Data 
from redacted clinical study reports produced for FDA premarket 
approval were only available for three trials (see supplementary 
table 1). In addition, we identified journal publications and 
conference abstracts for this set of studies through 
comprehensive literature searches (details reported 
elsewhere). 15 16 

Data collection and extraction 

We matched all known published papers and conference 
abstracts to the relevant studies. For each publication we 
extracted key study and participant characteristics and all 
reported data on effectiveness outcomes and adverse events. 
Where study data were reported in more than one publication, 
we used the most complete dataset aggregated across all known 
publications. One researcher extracted data and a second 
reviewer checked the data extraction. We resolved any 
discrepancies through consensus or recourse to a third reviewer 
where necessary. 

Data synthesis 

Using protocol definitions, we compared the outcomes collected 
in each study and presented in the individual participant data 
and internal reports against those reported in each study's 
publications and abstracts. 

Effectiveness outcomes 

We conducted separate meta-analyses of outcome data reported 
in internal reports and in publications and compared these 
against meta-analyses of the provided individual participant 
data. Meta-analyses were performed for pain outcomes 
(Oswestry disability index, SF-36 physical component score, 
back pain, leg pain) and fusion success for all Medtronic 
randomised controlled trials comparing rhBMP-2 with iliac 
crest bone graft. The definitions of these pain scores and of 
fusion are detailed elsewhere. 15 16 We analysed these outcomes 
at six weeks and at three, six, 12, and 24 months after surgery. 
Meta-analyses for all three data sources were conducted using 
DerSimonian-Laird random effects models. 17 

For each study we calculated the reported mean differences 
between treatment arms in the change in score from preoperative 
values, or the relative risk of successful fusion, and then 
combined these results across studies in "two stage" 
meta-analyses. Where standard deviations for outcomes were 
not reported in the published literature we imputed these values 
by assuming that the standard deviation of pain scores in the 
rhBMP-2 or iliac crest bone graft arm was the average of the 
standard deviations from those studies where this information 
was reported. 

Adverse events 

Adverse events were defined in Medtronic trial protocols as 
"any clinically adverse sign, symptom, syndrome, or illness that 
occurs or worsens during the operative and postoperative periods 
of the trial, regardless of causality, that is not otherwise being 
measured in the trial." Events were classified using Medtronic' s 
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own non-standardised "in-house" system developed in 
partnership with the FDA. 

Meta-analysis of adverse events was performed using the 
individual participant data and these analyses are reported in 
our clinical paper.' 6 However, meta-analysis based on data 
available in journal publications was not possible as data were 
too sparse for this to be meaningful. Thus a comparison of 
meta-analyses arising from the different data sources was not 
feasible. We therefore compared the total number of adverse 
events reported across study publications with the total number 
of events collected in the individual participant data. The 
reported categories of adverse events were also compared 
between sources. 

Results 

We received protocols, internal reports, and individual 
participant data for all 17 of Medtronic 's relevant rhBMP-2 
studies (13 randomised controlled trials, four single arm studies). 
Three of the randomised controlled trials suspended recruitment 
earlier than planned (fig 1 J). Our independent bibliographic 
searches identified a total of 32 journal publications and 
conference abstracts relating to the Medtronic studies (see 
supplementary table 1). We also identified two small randomised 
controlled trials funded independently of the manufacturer but 
found no evidence of any additional Medtronic studies. 18 19 

Ten of the 13 randomised controlled trials and one of the four 
single arm studies have been published in a scientific journal. 
Extremely limited data for one further randomised controlled 
trial (rhBMP-2/BCP Canada pivotal RCT) were available from 
three short conference abstracts. 20 22 Nine of the published 
randomised controlled trials were eligible for our meta-analyses 
of clinical effectiveness. One randomised controlled trial 
(MAVERICK) was not eligible for inclusion as it compared 
rhBMP-2 with an ineligible comparator. 

Reporting of effectiveness outcomes 

Supplementary table 2 shows which outcomes have been 
published in peer reviewed journals. No individual abstract or 
journal article reported all of the clinical outcomes known to 
have been collected. Studies collected a median of 16 (range 
11-18) effectiveness outcomes, with a median of nine (range 
1-14) outcomes reported in individual peer reviewed 
publications. Figure 2 shows that even combining information 
from all journal publications and conference abstracts could not 
identify a complete set of outcome data for any study (among 
published studies, 56% to 88% of known collected outcomes 
were mentioned across publications and abstracts). 

The most commonly defined primary outcomes in Medtronic 
study protocols were radiographic evidence of fusion and 
measures of pain/disability (Oswestry disability index; SF-36 
physical component score; back, hip, and leg pain scores). 
Around 70% of these outcomes have been presented somewhere 
in the published literature. Oswestry disability index, SF-36 
physical component score, fusion and additional surgery 
outcomes were available in some form for all 1 1 studies that 
have been published. Other frequently collected outcomes were 
rarely presented in the literature (for example, overall success 
14%, patient perceived effect 15%, doctor's perception of 
results, 0%). These latter measures were not analysed in our 
review of effectiveness as we did not a priori identify them as 
being of clinical importance. However, we do not rule out the 
possibility of selective reporting bias among these more 
sporadically reported, but less important outcomes. Detailed 



assessment of all studies using the Cochrane risk of bias tool is 
available elsewhere. 15 

Meta-analyses of effectiveness outcomes 

Our review of comparative effectiveness was limited to 
randomised controlled trials. 16 In all nine published randomised 
controlled trials comparing rhBMP-2 with iliac crest bone graft, 
data for the main pain outcomes (Oswestry disability index, or 
neck disability index, SF-36 physical component score, back 
and leg pain) were available. Estimates of uncertainty in these 
pain scores (for example, standard errors) were not commonly 
reported. We therefore chose to impute standard deviations for 
studies where these data were not provided, as described 
previously. 

Seven published Medtronic randomised controlled trials 
presented data on the number of successful fusions at six, 12, 
and 24 months after surgery. The remaining two published data 
on successful fusion only at 24 months after surgery. 

Internal reports and individual participant data were available 
for the nine relevant published randomised controlled trials plus 
two further unpublished randomised controlled trials 
(INTERFIX ALIF pilot, BCP Canada). By contrast with the 
published evidence, internal reports provided complete data on 
pain and function scores (including measures of variability) and 
fusion status at six, 12, and 24 months after surgery. Individual 
participant data contained some additional follow-up data, extra 
demographic data, and details on missing outcomes reporting. 

Figure 3JJ shows the results of meta-analyses of published pain 
and function outcomes against data from internal reports and 
individual participant data corresponding to the same set of 
published studies and from complete available data from the 
individual participant data and internal reports — that is, 
incorporating additional data from unpublished trials. Where 
observations were missing for patients in the individual 
participant data we used multiple imputation to impute plausible 
observations. This was not possible when analysing the tabulated 
data in the publications or internal reports as they lacked data 
on which patients had missing observations. This different 
handling of missing observations led to the slightly different 
results seen across data sources. Otherwise, results are almost 
identical for all four pain and function outcomes at all follow-up 
times. On this basis, there does not seem to be evidence of a 
systematic bias in the reporting of pain outcomes in the 
published literature. 

Figure 41! shows the results of meta-analyses for fusion success 
across the different sources of outcome data. While the results 
for the different data sources are broadly similar some 
differences exist. Including unpublished data in the internal 
report and individual participant data analyses increases relative 
risks at six months because of one unpublished trial 
(rhBMP-2/BCP Canada pivotal), which indicated a strongly 
beneficial result at this time point, with the increase in 
heterogeneity widening the confidence intervals. This variation 
was less noticeable at 24 months. The results, however, are 
generally consistent, with estimates derived from all sources 
having overlapping confidence intervals. There does not appear 
to be evidence of a systematic bias in the reporting of fusion in 
the published literature. 

Reporting of adverse event categories 

Table 1 J shows the adverse event categories as reported in the 
summary tables of internal reports (one single arm study and 
10 randomised controlled trials, of which nine informed our 
clinical effectiveness analyses). After the initial pilot study 
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(LT-CAGE pilot), it seems that a common set of adverse event 
categories were specified across all subsequent studies. Later 
studies (AMPLIFY, MASTERGRAFT pilot, MAVERICK) 
reported additional adverse event categories. 

For published studies, only a minority of categories that were 
recorded and reported in the internal reports have been reported 
in the published literature (table 1). This is summarised in figure 

5JJ. 

Publications relating to the two most recent randomised 
controlled trials'" 23 published in 2009 and 201 1 reported a 
comprehensive table of adverse events similar to that provided 
in the internal report. Of the earlier trials, three randomised 
controlled trials reported that there were no "unanticipated" 
events related to treatment. Although they limited reporting to 
"serious," "related," or "unanticipated" adverse events, these 
terms were not defined in either the publications or the 
corresponding clinicaltrials.gov protocols 3 8 24 (see 
supplementary table 3). The remaining publications limited 
reporting to a small proportion of the adverse events noted in 
the internal reports. There was no apparent consistency in the 
selection of adverse event categories. 

In some cases the way in which adverse events were reported 
also differed between sources reporting the same type of event. 
For example, a total of six retrograde ejaculation events occurred 
in the LT-CAGE open pivotal randomised controlled trials. The 
journal publication 5 failed to report that five of these six events 
occurred in the rhBMP-2 treatment group, whereas this fact was 
noted in the internal report 25 and captured in the individual 
participant data. The publication also reported this important 
adverse event as a proportion of all participants (6/146; 4.1%) 
rather than as a proportion of male participants (6/78; 7.7%). 

Several observations identified by other authors as being of 
serious concern (for example, heterotopic bone formation, 
osteolysis, radiculitis) were not included as adverse event 
categories in the main individual participant data datasets or 
internal reports, even though such observations were considered 
important enough to suspend recruitment in one study. 26 The 
manufacturer informed us (mediated through YODA) that this 
was because adverse events were classified on the basis of 
clinical signs and symptoms rather than by the possible cause 
of event. However, some journal publications described 
occurrences that, although not labelled as adverse events, could 
independently be interpreted as evidence of osteolysis 27 or 
heterotopic bone formation. 26 28 

For example, Haid et al 12 (INTERFIX PLIF randomised 
controlled trials) reported a statistically significantly higher rate 
of "new bone formation extending outside the disc space and 
into the spinal canal or neuroforamina" in rhBMP-2 treated 
patients than in controls (24 v 4 events, P<0.001), which we 
interpreted as heterotopic bone formation. This was mentioned 
in the internal report (box) but not recorded in the summary 
adverse event table. The "study progress" section of the same 
report states that "No unanticipated adverse device events have 
been reported . . . The reports of posterior bone formation are 
not considered unanticipated adverse device events since this 
was a possible adverse event listed in the risk analysis and 
informed consent form." Medtronic provided the relevant 
individual participant data from the outset and later confirmed 
that these data were the result of investigation done outside of 
the protocol that looked at this occurrence in both arms of the 
study and were subsequently reported in the Haid et al paper. 12 
They confirmed that heterotopic bone formation was 
systematically reviewed on computed tomography scans by an 
investigator surgeon and, based on protocol definitions at the 



time the studies were run, these radiographic observations of 
heterotopic bone formation may not have been reported as an 
adverse event. 

Similarly a description of "14 patients with transient localised 
areas of bone remodelling in the vertebral body adjacent to the 
allograft dowel" in a bone dowel pivotal randomised controlled 
trials publication 7 could be interpreted as possible evidence of 
osteolysis. Corresponding individual participant data were 
provided from the outset, again as data beyond the protocol. 
Medtronic confirmed that adverse events were classified on the 
basis of signs and symptoms, so potential adverse events such 
as heterotopic bone formation, osteolysis, and radiculitis not 
originally listed as adverse event categories in study protocols 
do not appear in summary tables in any internal reports. They 
suggested that any clinical consequences of such events may 
have been classified as "neurological" or as "back and/or leg 
pain." 

Total number of reported adverse events 

We attempted to compare the total number of adverse events 
that could be obtained from publications with those observed 
in the individual participant data. However, we note that since 
the same event may have been reported in more than one 
publication, our summation of events across publications may 
overestimate the actual number of reported events. Table 2|J 
shows that, despite this likely over-counting, far fewer total 
adverse events were reported across publications than were 
collected in the individual participant data. Around 18.5% of 
adverse events recorded in the individual participant data across 
all randomised controlled trials (published and unpublished) 
have been reported somewhere in the published literature (19% 
of events with rhBMP-2 and 18% with iliac crest bone graft). 
Among randomised controlled trials comparing the licensed 
Infuse preparation of rhBMP-2 against iliac crest bone graft, 
around 10.5% of adverse events collected in the individual 
participant data have been reported in the published literature 
(12% with Infuse, 9% with iliac crest bone graft). Restricting 
the analysis to published trials alone did not substantially change 
the proportion of reported individual participant data adverse 
events (23% across all published studies; 11% across published 
Infuse studies). Figure 6JJ shows the total number of adverse 
events reported in individual participant data and publications 
for each of these randomised controlled trials. 

This suggests any independent systematic review based only 
on data presented in journal publications and conference 
abstracts (that is, the public sources available to standard 
systematic reviews) would not be able to fully evaluate the 
safety of rhBMP-2 in spinal fusion. 

Discussion 

Controversy around use of recombinant human bone 
morphogenetic protein 2 (rhBMP-2) in spinal fusion began with 
suggestions that inadequate peer review and editorial oversight 
were responsible for an apparent absence of adverse events from 
early peer reviewed publications of industry sponsored studies. 
A subsequent investigation led by the editor in chief of The 
Spine Journal" 1 found fewer reported adverse events in academic 
publications of industry sponsored studies than in related study 
data available in FDA summaries and public meeting documents. 
The FDA materials available for that investigation appear to be 
partial outcome data from a subset of industry funded studies 
evaluating Infuse/LT-CAGE, Infuse/MASTERGRAFT, and 
AMPLIFY rhBMP-2 matrix preparations. Our investigation 
was able to explore this issue in greater depth having individual 
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Excerpt from Infuse/INTERFIX PLIF internal report 

Briefly, in December 1999, Medtronic Sofamor Danek suspended enrolment in this clinical trial. This stoppage occurred mainly because of 
the results of two patients who developed posterior bone over the cages. The exact cause of the bone formation in these cases is still 
unknown. Possible contributing factors have been speculated to be the less than ideal placement of the cages, the lack of countersinking 
performed the use of ADCON-L material during the surgery of one patient, the use of hemostatic agents such as gel foam sponges, and 
patient selection. 

In April 2001 , a group of spinal surgeons, including several investigators, evaluated the radiographs of the investigational patients in the 
clinical trial. They considered six of these patients to potentially have a clinically significant amount of posterior bone formation. The reviewers 
judged 17 patients to have no or slight bone formation and nine patients to have posterior bone formation but not to a possibly clinically 
significant amount. A few months later, a group of spinal surgeons reviewed the investigational patients' radiographs again. At this time they 
noted similar results, with 1 0 patients having posterior bone formation with some degree of foraminal or canal stenosis, nine patients having 
posterior bone formation without foraminal stenosis, and 14 patients having no or greater than the expected posterior bone formation. 



participant data on all recorded effectiveness and safety 
outcomes as well as internal reports provided for all Medtronic 
funded studies of rhBMP-2 for spinal fusion. Given their 
previous confidentiality, high degree of detail, and availability 
for all known studies, we consider the combination of individual 
participant data and internal reports to be the most 
comprehensive and trustworthy source of Medtronic trial 
evidence available to date. 

Incomplete reporting of trial outcome data 

We found that the published scientific literature only partially 
reported the total outcome data known to have been collected 
on the effects of rhBMP-2 in spinal surgery in manufacturer 
sponsored studies. This is partly because some studies were not 
published or were reported only in brief conference abstracts. 
For studies that were published, not all collected outcomes were 
reported. Despite being incomplete, meta-analyses for main 
effectiveness outcomes using data reported in publications and 
abstracts did not give substantially different results from 
meta-analyses using the individual participant data or the internal 
reports. The reporting of these results does not therefore seem 
to be substantially biased. 

In contrast, we found adverse events to be incompletely and 
inadequately described in the study publications. In general, 
published papers provided substantially less information than 
was available in the internal reports or in the individual 
participant data. The way in which the adverse event data were 
presented in the published literature was inconsistent and the 
rationale for presenting some adverse events and not others was 
rarely clear. Although broad, non-specific definitions of 
"related" and "unanticipated" adverse events appeared in 
confidential Medtronic protocols, it is not clear how these 
definitions were operationalised and the meaning of these terms 
was not given in any publication. Brief statements that simply 
noted "no unanticipated adverse events related to the use of 
Infuse" were uninformative and, in our opinion, manuscripts 
making such statements, without supporting evidence, should 
not have been considered acceptable for publication. Although 
the proportion of reported events was similar across treatment 
arms, incomplete reporting in publications precluded a 
comparative meta-analysis across sources. The academic 
literature alone is therefore an inadequate resource for evaluating 
the safety of rhBMP-2. This is not unique to these Medtronic 
studies and several authors have noted poor reporting of adverse 
events from studies in the academic literature more widely. 29 " 32 

Some potential adverse events that have caused concern in the 
post-marketing period (for example, heterotopic bone formation, 
radiculitis, osteolysis) were not routinely collected or reported 
in the original Medtronic studies. In one internal report, even 
though apparent heterotopic bone formation led to study 
suspension — with substantially more cases in the rhBMP-2 
arm — this was noted but not formally labelled as an adverse 
event in the internal report or subsequent academic publication. 12 



When this was queried with the manufacturer, the reasons given 
were that such events were not unanticipated and that adverse 
data collection was based on signs and symptoms. Again, this 
type of approach to reporting may not be unusual, but we suggest 
that in general any events of sufficient importance to suspend 
a trial or warrant additional analyses should be openly discussed 
in trial publications and reports. 

Under-reporting of outcome data may not be intentionally 
biased, but failure to report outcomes fully can undermine 
confidence in the reported findings and leaves study authors 
open to accusations of deliberate concealment. Given the large 
number of adverse events observed in most trials, study authors 
often discuss only those events considered to be of greatest 
clinical importance. However, modern electronic publishing 
methods enable these discussions to be supplemented by 
complete data on adverse events. We do not expect authors to 
discuss every single event or type of event; rather we would 
still expect them to draw the reader' s attention to the most 
important events (supported by a clearly stated rationale) within 
this summary data. Going further and routinely allowing 
independent scrutiny of trial data would not only protect 
sponsors and authors from accusations of concealment, but 
might also lead to earlier detection of harms. 

Our investigation cannot shed light on the decisions or 
motivations of the authors of rhBMP-2 studies; we can conclude 
only that trials collected a substantial amount of adverse event 
data that were not reported in the journal publications. A recently 
published US Senate Finance Committee investigation, 33 of 
which Medtronic strongly rejected many conclusions, was 
critical of publication practices. Assertions that "Medtronic was 
heavily involved in drafting, editing, and shaping the content 
of medical journal articles authored by its physician consultants 
who received significant amounts of money through royalties 
and consulting fees from Medtronic" underscore the importance 
of full disclosure of author contributions and full declaration of 
conflict of interest when reporting all clinical trials. 

Encouragingly, a complete list of adverse events similar to the 
tabulated adverse event data reported in the corresponding 
internal report has been published for the two largest rhBMP-2 
trials, key publications of which also disclose financial conflicts 
of interest. 10 23 Release of adverse event data is important because 
in practice clinicians and patients do not currently have access 
to information made available for regulatory purposes and so 
must make decisions weighing benefits and harms of 
interventions based on what is publicly available in the peer 
reviewed literature. We hope that this approach to disclosure 
will become routine in future. 

Improving access to trial data 

Increasing access to clinical trial data is currently the topic of 
intense debate. The BMJ has stated that it will no longer publish 
any trial of drugs or devices where the authors do not commit 
to making the relevant anonymised patient level data available, 



No commercial reuse: See rights and reprints http://www.bmj.com/permissions 



Subscribe: http://www.bmj.com/subscribe 



S/WJ2013;346:f3981 doi: 10.1 136/bmj.f3981 (Published 20 June 2013) 



Page 6 of 14 



RESEARCH 



and the AllTrials initiative (http://www.alltrials.net/) currently 
has over 53 000 signatures. There have also been moves toward 
greater openness and transparency from the European Medicines 
Agency and by the pharmaceutical multinational 
GlaxoSmithKline, while in the UK a House of Common's 
Science and Technology Committee inquiry on clinical trials 
is ongoing. 

As part of this discussion, Medtronic should be commended for 
taking the unprecedented step of voluntarily submitting their 
data to independent scrutiny, and for their commitment, beyond 
the two independent investigations commissioned by Yale 
University Open Data Access (YODA), to making their data 
available for further independent analysis. While our findings 
suggest that trial reporting practices have historically been 
inadequate, by allowing such an analysis the manufacturer has 
made a welcome move towards greater openness and 
transparency. 

With suitable safeguards to protect patient privacy and 
transparency around vested and potential conflict of interest, 
access to participant level data for research purposes should be 
the ultimate goal of initiatives to increase access to trial data. 
Contrary to common expectation, our analysis of the individual 
participant data provided proved to be no more resource 
intensive than collecting, extracting, and synthesising data from 
multiple overlapping journal publications and conference 
abstracts for each trial. We note that here we did not have to 
negotiate provision of data from trial investigators, which can 
be a time consuming first step for systematic reviews of 
individual participant data done under more usual circumstances. 
The individual participant data were relatively straightforward 
to check 16 and also enabled us to provide a more complete, 
detailed, and in-depth analysis than was possible from any other 
source. For example, individual participant data allowed us to 
investigate treatment by subgroup interactions across all 
included trials, whereas this was precluded by the summary 
and/or incomplete nature of the other data sources. However, 
we cannot entirely exclude the possibility of errors in the 
provided individual participant data; a "forensic" examination 
of data collection beyond standard data checking techniques 
was outside the aims and resources of this particular 
investigation. 

The findings of this and other reviews 34 suggest that even in the 
absence of individual participant data, access to complete study 
protocols and the reports that are produced by manufacturers 
for regulatory or other purposes also produce more accurate, 
reliable, and robust findings with less time and effort than 
relying on publicly available data alone. Release of internal 
reports could therefore be an important and potentially almost 
immediately achievable first step toward increasing transparency 
of trials. 

The debate around disclosure and data release will undoubtedly 
continue with further discussion of if, how, and to whom 
information and data should be released. The YODA initiative 
has been "proof of concept" showing that manufacturers can 
release data and that the systematic reviews based on these data 
are more complete and reliable than systematic reviews restricted 
to data presented in journal publications. 
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What is already known on this topic 

Concern is increasing about non-reporting of clinical study outcomes, particularly from industry funded studies 

Much controversy around the use of recombinant human bone morphogenetic protein 2 (rhBMP-2) for spinal fusion has stemmed from 
this problem 

Although systematic reviews are widely regarded as providing best evidence to inform decision making, they rely on the integrity of the 
available information and data from included studies in reaching reliable conclusions 

What this study adds 

This investigation compared a systematic review based on publications from industry funded rhBMP-2 studies with systematic reviews 
of their complete underlying study data 

Although published outcome data were incomplete, this did not lead to substantially different results for meta-analysis of effectiveness 
outcomes, but adverse event data were under-reported and did not permit meta-analysis 

While availability of individual participant data for research purposes remains the ideal, access to industry funded study protocols and 
reports could be an important first step toward increasing transparency of trials conducted for regulatory purposes 
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Tables 



| Reporting of adverse events in internal reports and journal articles for published Medtronic studies 
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Table 1 (continued) 
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Total reported in internal 


13 


23 


23 


22 


15 


24 15 18 


26 


27 


38 


reports 





















RCT=randomised controlled trial; Yes=reported in internal report and at least one full academic journal publication; No=only reported in internal report (clinical 
studies report) table of adverse events; Pub=only reported in a publication (specific events may have been subsumed under other categories in summary reports — for 
example, wound infection under "infections," pseudarthrosis under "non-union (pending)." 
LT-CAGE pilot reports fracture, other studies report vertebral fracture. 

Three Medtronic randomised controlled trials (INTERFIX ALIF pilot, Cornerstone pivotal, BCP Canada) and three non-randomised studies (Telamon, CRM Two-level, 
BCP Mexico) have not been published to date. 

*Dawson et al g report pseudarthrosis in two patients, and three wound infections (two surgical site, one graft donor site). 

fBoden et al 3 report one transient leg pain after surgery, one epidural haematoma, and one persistent low back/leg pain among patients receiving rhBMP-2. 
tSplit ilius and other. 
§Grouped together. 

HHaid et al 12 report one deep vein thrombosis as a vascular complication. 
"Not of neck cause. 
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able 2\ Comparison of number of adverse events reported in Medtronic individual participant data versus Medtronic publications 



Publications 


All studies (n=17) 


All published studies (n=11) 


Infuse studies (n=12) 


Published Infuse studies (n=9) 




IPD events 


Published 
events* (% of 
IPD) 


IPD events 


Published 
events* (% of 
IPD) 


IPD events 


Published 
events* (% of 
IPD) 


IPD events 


Published 
events* (% of 
IPD) 


Single arm 
studiest: 


rhBMP-2 


733 


169 (23.1) 


588 


169 (28.7) 


661 


169 (25.5) 


588 


169 (28.7) 


Randomised 
controlled trials: 


rhBMP-2 


1517 


288 (19.0) 


1222 


288 (23.6) 


621 


75 (12.1) 


592 


75 (12.7) 


ICBG 


1367 


245 (17.9) 


1080 


245 (22.7) 


541 


47 (8.7) 


516 


47 (9.1) 



IPD=individual participant data; rhBMP-2=recombinant human bone morphogenetic protein 2; ICBG=iliac crest bone graft, 
tlncludes rhBMP-2 (Infuse) comparison arm from the MAVERICK study. 

'"Published" values reflect maximum possible number of reported events summed across publications; some events may have been double counted. 
When calculating number of adverse events reported across publications: total number of adverse events were counted, not just "device related" or other subsets; 
potential adverse events (for example, heterotopic bone formation, osteolysis) were counted if they were reported, regardless of whether they were explicitly 
referred to as "adverse events" or not; number of events or the number of participants experiencing events were counted, whichever number was larger; where 
two publications reported on exactly the same study population but the reporting of adverse events differed, these values from each publication were summed; 
publications reporting on subgroups of the same study population were not counted if there was a publication also available that reported adverse events for the 
entire study population; where the number of events was not reported according to treatment arm, they were assumed to be distributed evenly between arms. 
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Figures 



Medtronic studies (n=17) 



Randomised controlled trials (n=13) 

; i ; 



Single arm studies (n=4) 



Published randomised 


Unpublished randomised 


Published single arm study 


controlled trials (n=10) 


controlled trials (n=3) 


(n-1) 






• Infuse/INTER FIX ALIF pilot 


• Infuse/LT-CAGE laparoscopic pivotal 






• rhBMP-2/BCP Canada pivotal 








• Infuse/CORNERSTONE ACDF pivotal* 





Unpublished single arm 
studies (n=3) 

• Infuse/TELAMON PEEK instrumented 
PLIF pilot 

• rhBMP-2/CRM two-level pilot 

• rhBMP-2/BCP Mexico pilot 



Eligible for effectiveness analyses (ICBG comparator) (n=9) 


Ineligible for effectiveness analyses (n=l) 


• Infuse/LT-CAGE pilot 


• Infuse/MASTERGRAFT pilot 


• MAVERICK Disc pivotalt 


• Infuse/LT-CAGE open pivotal 


• Infuse/CORNERSTONE ACDF pilot 




• Infuse/bone dowel pilot 


• rhBMP-2/BCPUS pilot 




■ Infuse/bone dowel pivotal* 


• AMPLIFY pivotal 




• Infuse/INTER FIX PLIF§ 







* Recruitment stopped after three patients; no outcome data collected 

t MAVERICK trial compares rhBMP-2 with MAVERICK disc replacement system 

t Recruitment stopped early "for business reasons" 

§ Planned enrolment of 220 patients suspended (at 67 patients) after bony overgrowth noted in some 



Fig 1 Medtronic studies included in analysis 



■ All available reports (journal articles and conference abstracts) 
□ Journal articles alone 



Randomised controlled trials 
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Fig 2 Proportion of measured effectiveness outcomes available from journal publications and conference abstracts 
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rhBMP-2=recombinant human bone morphogenetic protein 2; ICBG=iliac crest bone graft 

Fig 3 Meta-analyses of pain and function across three different data sources. rhBMP-2=recombinant human bone 
morphogenetic protein 2; ICBG=iliac crest bone graft 
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Fig 4 Meta-analyses of successful fusion across three data sources. rhBMP-2=recombinant human bone morphogenetic 
protein 2; ICBG=iliac crest bone graft 




Fig 5 Number of adverse event categories reported in Medtronic internal reports and journal publications by date of first 
patient enrolment 
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Fig 6 Total number of adverse events reported in Medtronic randomised controlled trials comparing recombinant human 
bone morphogenetic protein 2 (rhBMP-2) with iliac crest bone graft (ICBG): individual participant data (IPD) versus publications 
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